I claim: 

1 1 . In a computing environment having a connection to a network, computer readable code 

2 readable by a computer systeniin said environment, for enhancing performance of a multithreaded 

3 application, comprising: \ 

4 a plurality of client requests for connections; 

5 a plurality of worker threads 

6 a subprocess for receiving said plurality of client requests; and 

7 a subprocess for implementing ^scheduling heuristic to alleviate over-scheduling of said 

8 worker threads. \ 

UH 2. Computer readable code for enhancing performance of a multithreaded application 

^2 according to Claim 1, wherein: f \ A 

^ e 3 a first group of said worker threads are-tfctive threads, said first group being comprised of 

jj4 changeable ones of said plurality of worker threads\and having a changeable number of said 

L-L \ 
E — \ 

O 5 changeable ones, said changeable number being at leak one; and 

O \ j 

^ 6 said subprocess for implementing a scheduling Heuristic further comprises a subprocess for 

7 balancing said changeable number in said first group against a current workload comprised of one 

8 or more of said plurality of client requests. \ 

1 3 . Computer readable code for enhancing performance ofi a multithreaded application 

2 according to Claim 2, wherein said subprocess for balancing further comprises using an average 

3 delay. \ 
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1 4. Computer readable code for enhancing performance of a multithreaded application 

2 according to Claim 3, wherein said subprocess for balancing further comprises using a maximum 

3 delay. 

1 5. Computer readable code for enhancing performance of a multithreaded application 

2 according to Claim 4, wherein said average delay^nd said maximum delay are configuration 

3 parameters. 

0 . 

u§ 6. Computer readable code for enhancing performance of a multithreaded application 

08 

HI according to Claim 2, wherein: 

1 Li 

W a second group of said worker threads are blocked \hreads, said second group being 

01 \ 

y comprised of ones of said plurality of worker threads which 3f e not in said first group; and 

n 

J said blocked threads are stored in a Last-In, First-Out aueue. 

\ 

it-— s * 

H 7. In a computing environment having a connection to a network, computer readable code 

2 readable by a computer system in said environment, for enhancing performance of a multithreaded 

3 application, comprising: 

4 a subprocess for moving connections from a pending connections queue to a first queue 

5 when each of said connections are accepted; 

6 a subprocess for moving each of said connections from said first queue to a second queue 

7 when an initial data packet arrives for said connection; and 
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8 a subprocess for assigning a worker thread to each of said connections on said second 

9 queue. 

1 8. In a computing environment having a connection to a network, computer readable code 

2 readable by a computer system in said environment, for enhancing performance of a multithreaded 

3 application, comprising: 

4 a subprocess for receiving input from multiple sources; and 

5 a subprocess for merging said received input onto a single queue for scheduling. 

10 9. Computer readable code for enhancing performance of a multithreaded application 

2^ according to Claim 8, further comprising: 

yl 

3j ^ a subprocess for moving connections from a pending connections queue to a first queue 

ffl 

4ji when each of said connections are accepted; 

SO a subprocess for moving each of said connections from said first queue to said single 

6\z queue when an initial data packet arrives for said connection; and 

a r 5 

7rJ a subprocess for assigning a worker thread to each of said connections on said single 

8 queue. 

1 10. Computer readable code for enhancing performance of a multithreaded application 

2 according to Claim 9, wherein said subprocess for scheduling further comprises: 

3 a group of active worker threads comprised of changeable ones of a plurality of worker 

4 threads, and having a changeable number of said changeable ones, said changeable number being 
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at least one; and 

a subprocess for implementing a scheduling heuristic for balancing said changeable number 
in said active group against a current workload comprised of said client requests stored on said 
single queue. 

11. In a computing environment having a connection to a network, computer readable code 
readable by a computer systeAin said environment, for enhancing performance of a multithreaded 
application, comprising: \ 

a plurality of persistent connections; 
a plurality of worker threads;\ 

a subprocess for binding selected ones of said persistent connections to selected ones of 
said worker threads, wherein an executioia of said subprocess for binding results in a bound 
connection; and \ 

a subprocess for unbinding selected ones hf said bound connections, wherein an execution 
of said subprocess for unbinding results in an unbound worker thread. 

12. Computer readable code for enhancing performance of a multithreaded application 
according to Claim 1 1, wherein. \ 

said subprocess for binding further comprises using a 2-stage queue; and 
said subprocess for unbinding further comprises usmg said 2-stage queue. 

13. Computer readable code for enhancing performance of V multithreaded application 
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according to Clairri 12, wherein: 

said subprocess for binding using said 2-stage queue further comprises: 

a subprdcess for moving each of said persistent connections to said first stage 
when an initial data packet arrives for said connection; 

a subproces^br moving each of said persistent connections from said second 
stage to said first stage when oata is received for said connection; and 

a subprocess for scheduling said persistent connections from said first stage; and 
said subprocess for unbinding using said 2-stage queue further comprises: 

a subprocess for movmg selected ones of said bound connections from said first 
stage to said second stage when said selected bound connection goes idle; 

a subprocess for closing selected ones of said persistent connections in said second 
stage, responsive to a maximum idle pericfcfbeihg exceeded; and 

a subprocess for making sWl W>ound worker thread available to said subprocess 
for binding. \ 

14. Computer readable code for enhancing performance of a multithreaded application 
according to Claim 13, wherein said subprocess for unbinding further comprises: 

a subprocess for closing further selected ones oraaid persistent connections in said second 
stage, responsive to exceeding a maximum number of idleVonnections. 

15. A system for enhancing performance of a multithreaded application in a computing 
environment having a connection to a network, comprising: \ 
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a plurality of client requests for connections; 
a plurality of worker threads; 

means for receiving said plurality of client requests; and 

means for implementing a scheduling heuristic to alleviate over-scheduling of said worker 
threads. \ 

16. The system for enhancing performance of a multithreaded application according to Claim 

15, wherein: \ 

a first group of said workeAthreads are active threads, said first group being comprised of 
changeable ones of said plurality of worker threads, and having a changeable number of said 
changeable ones, said changeable number being at least one; and 

said means for implementing ^QMdKling heuristic further comprises means for balancing 
said changeable number in said first group\against a current workload comprised of one or more 
of said plurality of client requests. \ 

17. The system for enhancing performance df a multithreaded application according to Claim 

16, wherein said means for balancing further comprises using an average delay. 

18. The system for enhancing performance of a multithreaded application according to Claim 

17, wherein said means for balancing further comprises using a maximum delay. 

19. The system for enhancing performance of a multithreaded application according to Claim 
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2 18, wherein said average dela\and said maximum delay are configuration parameters. 

1 20. The system for enhancing performance of a multithreaded application according to Claim 

2 16, wherein: 

3 a second group of said worker \hr&d\ are blocked threads, said second group being 

4 comprised of ones of said plurality of workenthreads which are not in said first group; and 

5 said blocked threads are stored in a LastW First-Out queue. 

1 21 . A system for enhancing performance of a multithreaded application in a computing 

2Q environment having a connection to a network, comprising: 

3^ means for moving connections from a pending connections queue to a first queue when 

If! s 

4|!j each of said connections are accepted; 

%£ * 

5yi means for moving each of said connections from said first queue to a second queue when 

60 an initial data packet arrives for said connection; and 

7JZ means for assigning a worker thread to each of said connections on said second queue. 

1 22. A system for enhancing performance of a multithreaded application in a computing 

2 environment having a connection to a network, comprising: 

3 means for receiving input from multiple sources; and 

4 means for merging said received input onto a single queue for scheduling. 



1 



23. The system for enhancing performance of a multithreaded application according to Claim 
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2 22, further comprising: 

3 means for moving connections from a pending connections queue to a first queue when 

4 each of said connections are accepted; 

5 means for moving each of said connections from said first queue to said single queue when 

6 an initial data packet arrives for said connection; and 

7 means for assigning a worker thread to each of said connections on said single queue. 

1 24. The system for enhancing performance of a multithreaded application according to Claim 

2 23 T wherein said means for scheduling further comprises: 

n 

# a group of active worker threads comprised of changeable ones of a plurality of worker 

S3 

y]4 threads, and having a changeable number of said changeable ones, said changeable number being 

PJ 

3 , S 

!**5 at le&sLone; and 

s 6 means for implementing a scheduling heuristic for balancing said changeable number in 

Uf7 said active group against a current workload comprised of said client requests stored on said 

t: 

□ 8 single queue. 

D 

M: 

1 25. A system for enhanbmg performance of a multithreaded application in a computing 

2 environment having a connection to a network, comprising: 

3 a plurality of persistent comWibns; 

4 a plurality of worker threads; \ 

5 means for binding selected ones of saM persistent connections to selected ones of said 

6 worker threads, wherein an execution of said sub^rocess for binding results in a bound 
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connections and 

meansyfor unbinding selected ones of said bound connections, wherein an execution of 
said subprocess tor unbinding results in an unbound worker thread. 

26. The system fo\ enhancing performance of a multithreaded application according to Claim 

25, wherein: 

said means for binding further comprises using a 2-stage queue; and 
said means for unbinding further comprises using said 2-stage queue. 

27. The system for enhancing performance of a multithreaded application according to Claim 

26, wherein: 

said means for binding using kaiiL 2Atage queue further comprises: 

means for moving each of skid persistent connections to said first stage when an 
initial data packet arrives for said connection^ 

means for moving each of said persistent connections from said second stage to 
said first stage when data is received for said connection; and 

means for scheduling said persistent connections from said first stage; and 
said means for unbinding using said 2-stage quelle further comprises: 

means for moving selected ones of said bound connections from said first stage to 
said second stage when said selected bound connection goes\dle; 

means for closing selected ones of said persistet\connections in said second stage, 
responsive to a maximum idle period being exceeded; and 



CR9-98-027B 



53- 



mean* for making said unbound worker thread available to said subprocess for 
binding. \ 

28. The system for enhancing performance of a multithreaded application according to Claim 
27, wherein said means fonunbinding further comprises: 

means for closing further selected ones of said persistent connections in said second stage, 
responsive to exceeding a maximum number of idle connections. 

29. A method for enhancing performance of a multithreaded application in a computing 
environment having a connection \o a network, comprising the steps of: 

receiving a plurality of clieflflrreauests for connections; and 

implementing a schedulin^J^Jfaistic to alleviate over-scheduling of a plurality of worker 
threads to said plurality of client requests. 

30. The method for enhancing performance of a multithreaded application according to Claim 
29, wherein: \ 

a first group of said worker threads are\active threads, said first group being comprised of 
changeable ones of said plurality of worker threads, and having a changeable number of said 
changeable ones, said changeable number being at least one; and 

said implementing a scheduling heuristic step Vurther comprises balancing said changeable 
number in said first group against a current workload comprised of one or more of said plurality 
of client requests. \ 
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31..., The method for enhancing performance of a multithreaded application according to Claim 

30, wherein said balancing step further comprises using an average delay. 

32. The method for enhancing performance of a multithreaded application according to Claim 

31, wherein said balancing step farther comprises using a maximum delay. 

33. The method for enhancinj0)drfonhance of a multithreaded application according to Claim 

32, wherein said average delay an^ saip/maximum delay are configuration parameters. 

34. The method for enhancing performance of a multithreaded application according to Claim 
30, wherein: 

a second group of said worker threads a\je blocked threads, said second group being 
comprised of ones of said plurality of worker threads which are not in said first group; and 
said blocked threads are stored in a Last-In, \First-Out queue. 

35. A method for enhancing performance of a multithreaded application in a computing 
environment having a connection to a network, comprising the steps of: 

moving connections from a pending connections queue to a first queue when each of said 
connections are accepted; 

moving each of said connections from said first queue to a second queue when an initial 
data packet arrives for said connection; and 
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assigning a worker thread to each of said connections on said second queue. 

36. A method for enhancing performance of a multithreaded application in a computing 
environment having a connection to a network, comprising the steps of: 

receiving input from multiple sources; and 

merging said received input onto a single queue for scheduling. 

37. The method for enhancing performance of a multithreaded application according to Claim 

36, further comprising the steps of: 

moving connections from a pending connections queue to a first queue when each of said 
connections are accepted; 

moving each of said connections from said first queue to said single queue when an initial 
data packet arrives for said connection; and 

assigning a worker thread to each of said connections on said single queue. 

38. The method for enhancing performance of a multithreaded application according to Claim 

37, further comprising: 

a group of active worker threads comprised of changeable ones of a plurality of worker 
threads, and having a changeable number of said changeable ones, said changeable number being 
at least one; and 

wherein said scheduling step further comprises: 

implementing a scheduling heuristic for balancing said changeable number in said active 
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8 group against a current workload comprised of said client requests stored on said single queue. 

1 39. A method for enhancing performance of a multithreaded application in a computing 

2 environment having a connection to a network, comprising the steps of: 

3 binding selected ones of a plurality of persistent connections to selected ones of a plurality 

4 of worker threads, wherein an Execution of said binding step results in a bound connection; and 

5 unbinding selected ones of said bound connections, wherein an execution of said 

6 unbinding step results in an unbouira worker thread. 
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40. The method for enhancing performance of a multithreaded application according to Claim 

39, wherein: 

said binding step further comprises tainga 2-stage queue; and 
said unbinding step further comprises usipg said 2-stage queue. 

41 . The method for enhancing performance oi^a multithreaded application according to Claim 

40, wherein: 

said binding using said 2-stage queue step further comprises the steps of: 

moving each of said persistent connections to said first stage when an initial data 

packet arrives for said connection; 

moving each of said persistent connections f\om said second stage to said first 

stage when data is received for said connection; and 

scheduling said persistent connections from saidYirst stage; and 
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9 said unbinding using said 2-stage queue step further comprises the steps of: 

10 moving selected ones of said bound connections from said first stage to said 

1 1 second stage when said selected bound connection goes idle; 

12 closing selected onfes of said persistent connections in said second stage, 

13 responsive to a maximum idle peiio<M)eW exceeded; and 

14 making said unbound^rarker thread available to said subprocess for binding. 

1 42. The method for enhancing performance of a multithreaded application according to Claim 

2 41, wherein said unbinding step further comprises the step of: 

33 closing further selected ones of said persistent connections in said second stage, 

43 responsive to exceeding a maximum number of idle connections. 
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